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We present single-crystal neutron scattering measurements of the spin-1/2 equilateral triangular-lattice anti¬ 
ferromagnet Ba 3 CoSb 209 . Besides confirming that the Co 2+ magnetic moments lie in the ab plane for zero 
magnetic field and then determining all the exchange parameters of the minimal quasi-2D spin Hamiltonian, we 
provide conclusive experimental evidence of magnon decay through observation of intrinsic line-broadening. 

Through detailed comparisons with the linear and nonlinear spin-wave theories, we also point out that the 
large-S' approximation, which is conventionally employed to predict magnon decay in noncollinear magnets, is 
inadequate to explain our experimental observation. Thus, our results call for a new theoretical framework for 
describing excitation spectra in low-dimensional frustrated magnets under strong quantum effects. 

PACS numbers: 61.05.F-, 75.10.Jm, 75.45.+j, 78.70.Nx 


Introduction .—The S = 1/2 triangular-lattice Heisen¬ 
berg antiferromagnet (TLHAF) is the paradigmatic example 
of a two-dimensional (2D) frustrated quantum magnet (TJ- 
na. The combination of frustration, strong quantum fluc¬ 
tuations and low dimensionality is anticipated to produce 
strong deviations from semiclassical theories. While sev¬ 
eral distorted triangular-lattice materials, such as ^-(BEDT- 
TTF) 2 Cu 2 (CN )3 G3, Cs 2 CuX 4 (X = Cl EM! and Br 
l20l ). and CuCr0 2 (21][22), have been investigated in the past, 
the distorted structures introduce additional terms, such as 
the Dzyaloshinskii-Moriya (DM) interaction, into the paradig¬ 
matic Hamiltonian [fT6ll20 231. 

The equilateral triangular-lattice quantum antiferromagnet 
Ba 3 CoSb 2 0 9 was synthesized recently [24-29]. The Co 2+ ion 
has a Kramers doublet ground-state due to the spin-orbit cou¬ 
pling, and this doublet can be described as an effective spin- 
1/2 moment. In addition, the high symmetry of the hexagonal 
crystal structure, P6s/mmc [24 28,1, forbids DM interaction 
for pairs up to third nearest-neighbor (NN) in the same ab- 
plane and between any pair of spins along the c-axis (25l . 

Powder neutron diffraction measurements presented the 
noncollinear 120° structure with the magnetic wave vector Q 
= (1/3,1/3,1) (24). The Neel temperature was found to be 
^ 3.8 K and a rich temperature-magnetic field phase diagram 
was reported up to 32 T 12514281 . Electronic spin resonance 
(ESR) (27l and nuclear magnetic resonance (NMR) (28l mea¬ 
surements suggested a spin model with small easy-plane ex¬ 
change anisotropy and an exchange interaction along the 0 
axis much weaker than the NN intralayer exchange. This ob¬ 
servation is consistent with the alternation of magnetic (Co 2+ ) 
and nonmagnetic (Sb 2 Og bioctahedra) layers along the c- 
direction. While more precise determination of the model pa¬ 
rameters requires inelastic neutron scattering (INS) measure¬ 
ments, such detailed information is indeed physically relevant. 


The reason is that, according to the semiclassical theories in 
Refs. [8] and 9] “smoking gun” features of the magnetic exci¬ 
tations of the 2D 6=1/2 TLHAF, such as the line-broadening 
of the single-magnon excitations resulting from spontaneous 
magnon decays ITHMEqI, can be rather sensitive to small 
deviations from the ideal model. 

In this Letter, we present direct evidence of the magnetic 
structure in Ba3CoSb 2 09 and the detailed profile of magnon 
excitations obtained by neutron scattering measurements. We 
confirm the 120° order lying in the ab plane at zero-field [ 27 , 
|28j and determine the exchange constants of the minimal 
quasi-2D XXZ Hamiltonian proposed in Refs. ElES and[28l 
The INS spectrum also exhibits intrinsic line-broadening. By 
comparing the INS profile against the linear spin-wave (LSW) 
theory and the LSW+1/5' corrections, we show that the 
quantum fluctuations produce a strong renormalization of the 
magnon dispersion as previous theoretical predictions EH). 
More importantly, however, our thorough examination reveals 
that the semiclassical (i.e., large S ) treatment is inadequate to 
explain the observed magnon decay and the associated line¬ 
broadening in this spin-1/2 system, thereby pointing to a need 
for developing an alternative theoretical framework. Thus, al¬ 
though quantum fluctuations are not enough to destroy mag¬ 
netic ordering in Ba 3 CoSb 2 Og, our study indicates that these 
fluctuations are qualitatively modifying the excitation spec¬ 
trum relative to the semi-classical (large - S ) regime. 

Experiments .—The single crystal of Ba 3 CoSb 2 09 [^lg, di¬ 
ameter (5mm) x length (15mm)] was grown by the floating- 
zone technique and oriented in the (HHL) scattering plane 
for INS measurements. The unpolarized neutron diffraction 
data were obtained using the HB-1A triple-axis spectrome¬ 
ter (TAS) and the HB-3A four circle diffractometer at High 
Flux Isotope Reactor (HFIR), Oak Ridge National Labora- 
tory (ORNL) ED- The absence of site-disorder between 
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FIG. 1. (color online) Comparison between the observed magnetic 
Bragg peak intensities at 1.7 K on the HB-1A TAS and the simulated 
ones based on the 120° structure in the (a) ab plane and (b) ac plane. 
The solid lines are guides to the eye. Magnetic Bragg peaks at (c) 
(1/3,1/3,3) and (d) (2/3,2/3,1) measured with polarized neutrons at 
1.7 K on HB-1. The backgrounds have been subtracted. P and q are 
the polarization and the scattering vector, respectively. 


Co and Sb was confirmed within an error of 1% and the 
magnetic wavevector (Q) is (1/3,1/3,1) 1241 . We collected 
twenty magnetic Bragg peaks at 1.7 K, and refined the data 
with FULLPROF j32|. Two variants of the 120° structure 
were compared as the “afr” and “ac” plane models, which 
are favored by easy-plane and easy-axis anisotropy, respec¬ 
tively I'll, I2ll33l . The ab plane model corresponds to a 120° 
structure with all spins in the ab plane [Fig.[1Ja)], while the ac 
plane model assumes the 120° structure with one third of the 
moments parallel (or antiparallel) to the c-axis [Fig.|TJb)]. Al¬ 
though the same magnetic Bragg peaks were generated from 
both structures, the related scattering intensity profiles were 
different. Our data are consistent with the ab plane model, 
Figs.[IJa) and (b). 

We measured a series of magnetic Bragg peaks, 
(1/3,1/3,1), (2/3,2/3,1), (1/3,1/3,3), and (1/3,1/3,5), and 
nuclear peaks, (1,1,0) and (0,0,6), using the HB-1 polarized 
neutron TAS at HFIR, ORNL for further confirmation of the 
spin directions. Figures[ljc) and (d) show the (1/3,1/3, 3) and 
(2/3,2/3,1) peaks, respectively. Since they are observed in 
the spin-flip channel with the initial polarization vector P par¬ 
allel to the scattering vector q, both peaks are magnetic. More 
information on the magnetic order can be obtained by the neu¬ 
trons polarized along the [110] direction, which is perpendic¬ 
ular to the (HHL) plane, and then evaluating the intensity ra¬ 
tio / S f// n sf between the spin-flip and non-spin-flip channels. 
In our configuration, the spin-flip (non-spin-flip) scattering 
originates from the in-plane (out-of-plane) spin components. 
Through this analysis, the ab plane model should be correct 
(Table [I]). This confirms the easy-plane anisotropy proposed 


TABLE I. Ratios between the spin-flip and non-spin-flip scattering 
intensities measured with neutrons polarized perpendicular to the 
scattering wavevector q. 


index 

7f / 7isf 

magnetic model calculations 

ab plane model 

ac plane model 

(2/3,2/3,1) 

0.16(2) 

0.12 

0.88 

(1/3,1/3,1) 

0.36(3) 

0.33 

0.67 

(1/3,1/3,3) 

0.81(2) 

0.82 

0.18 

(1/3,1/3,5) 

0.94(2) 

0.92 

0.08 


in the ESR [27] and NMR l28l measurements in disagreement 
with Refs. l24l-[26l B71l . 

To investigate the spin dynamics in Ba 3 CoSb 209 , we per¬ 
formed INS measurements on CG-4C cold neutron TAS at 
HFIR and Cold Neutron Chopper Spectrometer (CNCS) at 
Spallation Neutron Source (SNS), ORNL. At the CG-4C TAS, 
the final energy was fixed at either 5 or 3.5 meV. The incident 
energy on CNCS was fixed at 3.315 meV. Figures [2ja)-[2jc) 
show the scattering profile at 1.5 K along high-symmetry di¬ 
rections in the reciprocal space. Three dominant modes are 
observed as expected for the 120° structure. To be consistent 
with the theoretical calculation, Miller indices in following 
texts are labelled by the model notation. 

The overall bandwidth of discernible single-magnon 
branches is around 1.7 meV for the in-plane dispersion. 
While our INS measurements resolved the finite band¬ 
width ^ 1.1 meV along the c-axis for the Goldstone mode 
[Fig.|2jc)], which implies a nonnegligible inter-layer (antifer¬ 
romagnetic) exchange. The relevance of the finite inter-layer 
exchange was pointed out recently [12, 28 ) to explain a weak 
anomaly in the magnetization curve at around 22 T for a mag¬ 
netic field B parallel to the afr-plane 123]. The correspond¬ 
ing anomaly was clearly observed by NMR [28]. The gap of 
the quadratic band at q = (2/3,-1/3,-1) is around 0.65 meV, 
which agrees well with 170 GHz by ESR [27]. Around q = 
(1/2,0,-1) (Mi point), we observed roton-like minima and a 
flat mode, such as in the dispersion along K[ —» Mi -A Yi or 
Xi^M^r, [Fig.^a)]. 

The most interesting feature of the magnetic excitations 
is the line-broadening observed throughout the whole Bril- 
louin zone (BZ) (Fig. [2]), which was missed due to the in¬ 
strument and sample limitations in Ref. l26l . As demon¬ 
strated in the constant-q plots near M x point, q = (1/2, 0, 
-1), the line-widths are several times broader than the in¬ 
strument resolution [Fig. [3ja)]. As discussed in Ref. ED, 
we have excluded the possible extrinsic broadening factors, 
such as the sample inhomogeneities, the instrument reso¬ 
lution and data rebinning effects. Similar line-broadening 
was reported in the 2D trimerized triangular antiferromagnet 
LuMnOs l34l . In Fig. [3jb), we show the constant-frequency 
cut at huj = 1.3 meV focused on the BZ boundary. Besides 
the triangular-shaped intensity around Ki and points cor¬ 
responding to a nearly flat single-magnon excitation flOl . we 
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FIG. 2. (color online) INS spectra of Ba 3 CoSb 209 as a function of the momentum and energy transfer at T — 1.5 K along the high symmetric 
(a) intralayer directions and the inter-layer (b) (1/2,0,L) and (c) (2/3,-1/3, L) directions in the reciprocal space. The background has been 
subtracted. The filled circles are peak positions from the measurements at the CG-4C TAS. The red rectangular frame in (a) represents the 
region where the decay effect is distinct and the details are discussed in Fig.3(a). (d)-(f) The intensity plot of the dynamical structure factor 
along the same symmetry lines as in (a)-(c) for J — 1.7 meV, J' / J — 0.05, and A = 0.89 at T = 0 calculated by the nonlinear spin-wave 
approximation. The energy resolution (0.063 meV) has been convoluted. The solid lines represent the poles in the LSW approximation. 



Energy (meV) 


FIG. 3. (color online) (a) The constant-q scans near Mi point, q = 
(1/2, 0,-1). The horizontal error bars indicate the instrumental res¬ 
olution. Thin dashed lines indicate individual fitted Gaussian peaks 
and background, and the solid line is their sum. The very broad fea¬ 
ture above 2 meV is attributed to the two-magnon continuum, (b) The 
constant-energy cut at 1.3 meV as a function of q = (H, K, L = — 1). 
The dashed lines are the BZ boundaries. 

observed relatively blurred circular-shape intensity. This fea¬ 
ture resembles the one observed in the prototypical 2D TL- 
HAF model DEI In addition to these broadened quasiparti¬ 
cle peaks, we observed more diffusive features at higher fre¬ 
quency fajj > 2meV [Figs. |2ja)-(c)], which are likely due 
to the longitudinal spin fluctuations associated with a two- 
magnon continuum. Finally, we found that the Goldstone 
mode emanating from the Bragg spot q = (2/3,-1/3,-1) has 


a rather weak intensity compared to the quadratic gapped 
branch. Although we believe this is not an experimental ar¬ 
tifact, this observation is rather unusual. 

Spin-wave theory. —The INS results were analyzed by the 
LSW theory and the LSW +1/5 corrections based on the 
spin-1/2 quasi-2D XXZ Hamiltonian on a vertically stacked 
triangular lattice: 

H=jY^ (S*S?, + svs v r , + A S Z T S Z T ,) 

<r.r'> 

+ j'Y J {s x r s* r+& + s v r s v r+i + a s;s; +g ). (i) 

r 

Here (r, r') runs over the in-plane NNs. J and J 7 (J, J f > 0) 
are the intra- and inter-layer NN antiferromagnetic exchange, 
respectively. A < 1 parameterizes the easy-plane exchange 
anisotropy. This is a minimal extension of the isotropic 2D 
TLHAF model (J' = 0 and A = 1) (Mil. The classi¬ 
cal ground state for J' > 0 and A < 1 coincides with the 
experimentally observed 120° structure. A tentative rough 
estimate J « 1.6 meV can be made by comparing the sat¬ 
uration field value (32.8 T for B || c [271) with gp B B sat = 
[3(1 + 2A) J + 2(1 + A) J']S assuming J'/J, 1-Acl and 
g = 3.87 for B || c (H. This suggests the temperature for 
our INS measurements to be T « 0.1 J. 

The spin-wave theory is derived by the standard Holstein- 
Primakoff transformation relative to the 120° structure. The 
LSW dispersion, cco(q), is obtained by diagonalizing the 
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quadratic part of the spin-wave Hamiltonian. The spiral 120° 
ordering leads to three branches of poles in the dynamical 
spin structure factor at cco(q) and cco(q ± Q) [the solid lines 
in Figs. |2jd)-[2jf)]. Several qualitative features of the spec¬ 
trum can be already captured at this LSW level. First, the 
gap (« 0.65 meV) of the quadratic branch at q = (2/3, -1/3, -1) 
is induced by the easy-plane exchange anisotropy. This gap 
is proportional to \A — A. The bandwidth of the Goldstone 
mode along the [001] direction is oc \J J' / J, implying that 
a rather small value of J'/ J can explain the observed band¬ 
width (« 1.1 meV) [Fig. [2^c)]. These observations remain ro¬ 
bust after including the next order corrections in 1/S. The 
overlap near q = (2/3, -1/3,0) of the gapped and gapless high 
intensity branches along q = (2/3,-1/3, L) is another charac¬ 
teristic ofBa 3 CoSb 2 0 9 [Fig.[2|c)]. 

To quantify the effect of quantum fluctuations on the 
single-magnon spectrum, we include the next order in 
1/5 to compute the dynamical structure factor 5(q, uj) = 
(27riV)- 1 5: rir ,/r oo ^e i[ ‘" t “ q(r “ r,)] (S r (9-S r ,(0)) (N is 
the total number of Co 2+ ions) at T = 0. The result is 
shown in Figs.|2jd)-[2|f), where the experimental energy res¬ 
olution (« 0.063 meV) has been convoluted ED- This quan¬ 
tum correction arises from the cubic terms that appear in 
the spin-wave Hamiltonian because of the noncollinear na¬ 
ture of the spin ordering and from a Hartree-Fock decoupling 
of the always present quartic terms fTHTOl [30 ]. The param¬ 
eters of our best fitting are J = 1.7 meV, J'/ J = 0.05, 
and A = 0.89. They are chosen to reproduce the gap of the 
quadratic branch atq= (2/3,—1/3,—1), the bandwidth of 
the Goldstone mode along the [001] direction, and the satura¬ 
tion field for B || c |[3Tj. The main difference relative to the 
previous estimates from ESR measurements (J'/J = 0.026 
and A = 0.94) El is the stronger exchange anisotropy. By 
comparing against the LSW results, we confirm the strong 
downward renormalization [as large as « 40% near q = (2/3, - 
1/3,-1)] of the single-magnon dispersion. This is a salient 
feature of frustrated low-spin magnets relative to unfrustrated 
systems. For instance, the renormalization due to 1/5 cor¬ 
rections is upward in the square-lattice 5 = 1/2 antiferro¬ 
magnetic Heisenberg model ED. A rather small downward 
renormalization of & 5% is observed in the 5 = 2 triangular 
lattice compound LuMnOs because of the rather large value 
of the spin l34l . 

While many key features of the measured spectra are well 
captured by our minimal model, there are several noteworthy 
discrepancies. First, as expected, the calculation yields high 
intensity for the Goldstone mode. Second, while the shape of 
the low-frequency dispersion (< 1.5 meV) is well reproduced, 
the calculation overestimates the energy of the high-frequency 
part (e.g., « 2.3 meV near Mi point whereas it is « 1.7 meV 
experimentally). This overestimate is a robust feature of our 
minimal Hamiltonian {]]) at both LSW and LSW + 1/5 lev¬ 
els ED. We examined the effect of the antiferromagnetic 
next-nearest-neighbor intralayer exchange J 2 , which however 


lowers both energy scales and relatively speaking, the separa¬ 
tion between the two branches increases with J 2 on . 

More importantly, the LSW +1/5 calculation yields quite 
stable quasiparticle peaks [Figs. |2fd)-[2jf)] instead of the ob¬ 
served line-broadening in the parameter regime relevant for 
Ba 3 CoSb 2 09 [Figs. [2^a)-[2jc)] . The large 5 theory applied to 
the 2D isotropic TLHAF model predicts that single magnon 
excitations can decay into two-magnon continuum in a large 
region of the BZ where the kinematic conditions are satis¬ 
fied mm 1301. Such magnon decays make the magnon life¬ 
time finite and cause the line-broadening. However, the non- 
negligible easy-plane exchange-anisotropy in Ba 3 CoSb 2 09 
implies that this semiclassical scenario fails to reproduce the 
experimental observation because, as already pointed out in 
Refs. EH, the associated gap opening violates the kinematic 
condition in the increasingly large area of the BZ l3ll . In ad¬ 
dition, the inter-layer coupling also acts against spontaneous 
magnon decays. One possibility is that we are missing some 
significant interactions in our minimal Hamiltonian Q- An al¬ 
ternative explanation is that semiclassical approaches are sim¬ 
ply inadequate to describe magnon decay in low-dimensional 
frustrated spin systems with small 5. 

Conclusions .—In summary, our neutron diffraction mea¬ 
surements of single-crystal Ba 3 CoSb 2 09 confirm that the 
zero-field magnetic ordering is a 120° structure in the ab 
plane. By comparing our measurements against the dynam¬ 
ical spin structure factor obtained from the LSW + 1/5 treat¬ 
ment of a stacked triangular-lattice 5 = 1/2 XXZ model, 
we extracted both exchange and anisotropy parameters. Our 
results indicate that Ba 3 CoSb 2 09 is an almost ideal realiza¬ 
tion of an equilateral 5 = 1/2 TLHAF. The measured INS 
profile exhibits several salient features theoretically predicted 
for frustrated quantum magnets, such as the strong downward 
renormalization of the magnon dispersion, roton-like minima, 
flat modes near the BZ boundary, and the line-broadening 
throughout the entire BZ. However, our detailed comparison 
between the experiments and the large 5 treatments reveals 
that the observed magnon decay in Ba 3 CoSb 2 09 cannot be 
explained with a semi-classical treatment. Thus our study sug¬ 
gests that a new theoretical framework is need to describe the 
low-energy excitation spectrum of magnetically ordered low¬ 
dimensional frustrated magnets. 
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FIG. 4. Dynamical spin structure factor in the 2D nearest-neighbor 
XXZ model at T — 0 for selected values of the easy-plane anisotropy 
A. The energy resolution hSu ~ 0.063 meV in our neutron scat¬ 
tering measurement has been convoluted. The arrows indicate the 
quadratic branch at K point for A < 1. J — 1.7 meV is assumed. 


NONLINEAR SPIN-WAVE ANALYSIS 

We summarize the results of the nonlinear spin-wave (LSW 
+ 1/5) calculation [7 -10| of the dynamical spin structure 
factor for the quasi-2D XXZ model on the stacked triangu¬ 
lar lattice. In addition to the easy-plane exchange anisotropy 
and the inter-layer coupling, we examine the effect of the 
intra-layer next-nearest-neighbor (NNN) coupling J 2 . The ex¬ 
tended Hamiltonian is 

= J X i S r S r’ + S V rSr' + ^S^) 

<r,r'> 

+ j 2 X (szs*, + sysy, + As*s z r ,) 

(r,r') 2 

+ J' X ( W +s + S r S r+B + AS r *S? +i ) , (2) 

r 

where (r, r') and (r, r ')2 run over nearest neighbor and NNN 
pairs in each layer, respectively. 


Nearest-neighbor XXZ model in the 2D limit 

We focus on the parameter dependence of (i) the line broad¬ 
ening of the single-particle dispersion and (ii) its renormaliza¬ 
tion, especially near the top of the dispersions. We begin with 
the case of J r = J 2 = 0 and examine the effect of A < 1 at 
T = 0. In Fig. [4j we show the A-dependence of the dynami¬ 
cal spin structure factor. Our results demonstrate that the line 
broadening is significantly suppressed throughout the whole 
Brillouin zone for A « 0.89, which is required to explain the 
sizable gap « 0.65 meV (around 40% of J ) of the quadratic 
band at the Ki and K[ points in Ba 3 CoSb 209 . As discussed in 
Refs. 00, the line broadening evident in the isotropic case 
A = 1 is largely due to the magnon decay process involv¬ 
ing the gapless k = ±Q magnons, which however become 
gapped for A < 1. This implies that, as A decreases, decays 
with emission of k = ±Q magnons are kinematically prohib¬ 
ited in an increasingly large region of the Brillouin zone 01. 
Thus, the sizable easy-plane exchange anisotropy required to 
explain the observed gap is incompatible with the observed 
line broadening within the spin-wave approach. 

Quasi-2D nearest-neighbor XXZ model 

Next, we examine the effect of the antiferromagnetic inter¬ 
layer exchange J' > 0 (Fig. [5]). As expected, the dominant 
effect of J f > 0 appears in the dispersion along the inter-layer 
direction. For small J'/J, the bandwidth of the Goldstone 
mode and the quadratic mode along the third direction scale as 
oc y/J'/J and J', respectively. As a consequence, at a certain 
value of J'/J, these modes touch to each other at the K and 
K' points [q = (1/3,1/3,0), (2/3,—1/3, 0)], as observed 
in Ba 3 CoSb 209 . As can be seen in Fig. [5j the intrinsic line 
broadening is basically absent in the whole Brillouin zone. 

Meanwhile, we note that a Schwinger bosons mean field ap¬ 
proach yields a spectrum with broadening due to deconfined 
spinons m, bearing some resemblance to the observed re¬ 
sults. After extending this approach to discuss spinon con¬ 
finement as a more reliable description of a magnetically or¬ 
dered state, it may offer a way of reconciling the discrepancy 
between theory and experiments. 

Effect of J 2 

The other major discrepancy between our theory and exper¬ 
imental observations in Ba 3 CoSb 2 C >9 is about the distance be¬ 
tween tops of different magnon branches [see, e.g., Figs. 2(b) 
and 2(e) in the main text]. Theoretically, the LSW approxi¬ 
mation predicts the frequencies at the Mi point (correspond¬ 
ing to the M point in 2D) to be y / 5/2 J and J for the 2D 
nearest-neighbor isotropic TLHAF. On the other hand, our 
INS measurements show that these frequencies are « 1.7 meV 
and « 1.3 meV in Ba 3 CoSb 209 , and the corresponding ratio 
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FIG. 5. Comparisons between J'/J = 0.01 (top row) and J'/J = 0.04 (bottom row) for selected values of the exchange anisotropy: 
A = 0.96, 0.92, and 0.88. The inset shows the first Brillouin zone. The energy resolution of H5uj « 0.063 meV has been convoluted. 
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FIG. 6. The J 2 -dependence of the dynamical spin structure factor at T = 0 (A = 0.89 and J'/J — 0.05). The energy resolution of 
hSu « 0.063 meV has been convoluted. 


~ 1.3 between them is considerably smaller than the theoret¬ 
ical value. As can be seen in Figs. [4] and [5j the change of 
the ratio between the two due to A < 1, J' > 0, and the 
lowest-order 1/S corrections is rather small. In Fig. [6] we also 
examine the effect of the antiferromagnetic intra-layer NNN 
exchange, J 2 , to see whether this discrepancy can be reduced 
by introducing an additional source of frustration. However, 
J 2 renormalizes both branches downwards resulting in a ratio 
that is even higher than the one obtained for J 2 = 0. 


DETERMINATION OF SITE-DISORDER BY THE SINGLE 
CRYSTAL NEUTRON DIFFRACTION 

To exclude the possibility that the observed linewidth 
broadening is caused by sample inhomogeneity, we collected 
more than 200 inequivalent nuclear Bragg peaks on the Four- 
Circle Diffractometer, HB3A at HFIR, ORNL with the neu¬ 


tron wavelength of A = 1.003 at room temperature. The Ri- 
etveld refinement was carried out using the FULLPROF pro¬ 
gram, Fig|7] The site-disorder between Co 2+ and Sb 5+ ions 
is determined to be negligible with the standard deviation of 
1 %. 


INSTRUMENTAL RESOLUTION AND DATA BINNING 
EFFECT 

Another possibility to cause the linewidth broadening is the 
instrumental resolution and data binning effect. 

Since the dispersion modes are flat at the band top, the q- 
resolution effect is small and the energy-resolution should be 
dominant at the high energy region(above ~ 1.0 meV). Al¬ 
though we have convoluted the calculated dispersions with an 
energy resolution of 0.063 meV, which is the energy resolu¬ 
tion at the elastic line, the measured dispersions are still far 
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Observed F 1 2 3 4 5 6 7 8 9 10 11 (arb. units) 


FIG. 7. Comparison between the observed intensities, corresponding 
to the squared nuclear structure factors, at 300 K on the HB-3A and 
the calculated ones based on the hexagonal structure with a symmetry 
of, P 62 ,/mmc. The solid line is a guide to the eye. 


broader than the calculated ones. The instrumental resolution 
does not cause the significant broadening. 

In order to check the data binning and integration effects, 
we have performed data analysis with several different bin¬ 
ning/integration conditions: The two excitations at Mi-point 
do not change the linewidth with the different smoothing lev¬ 
els. Hence, the binning and integration effects do not cause 
the broadening. 

Comparing to the other classical triangular-lattice anti- 
ferromagnets with noncollinear magnetic structure, such as 
CuCr 02 [22], and CuFeo. 965 Gao.o 3 s 02 j36'], the linewidths 
of Ba 3 CoSb 20 g are broader, which is due to the small spin 
value (S = 1/2) and the related strong quantum effect. 
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